Method for encoding and method for decoding a color transform and corresponding devices

ABSTRACT

A method for encoding a colour transform is disclosed that comprises encoding first parameters representative of video signal characteristics of colour output decoded pictures remapped by said at least one color transform; and encoding second parameters representative of said at least one colour transform.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. application Ser. No.15/991,808 filed on May 29, 2018, which is a continuation of U.S.application Ser. No. 14/905,610 filed on Jan. 15, 2016 (U.S. Pat. No.10,051,254), which claims the benefit, under 35 U.S.C. § 365 ofInternational Application PCT/EP14/064783, filed Jul. 10, 2014, whichwas published in accordance with PCT Article 21(2) on Jan. 22, 2015 inEnglish and which claims the benefit of European Patent Application13306010.3, filed Jul. 15, 2013, European Patent Application 13306068.1,filed Jul. 24, 2013, European Patent Application 13306291.9, filed Sep.23, 2013 and European Patent Application 13306707.4, filed Dec. 12,2013.

1. FIELD OF THE INVENTION

The invention relates to colour transform encoding. Specifically, amethod for encoding a colour transform, a corresponding decoding method,encoding device and decoding device are disclosed.

2. BACKGROUND OF THE INVENTION

The rendering of reconstructed images onto an end-device display is ofkey importance to insure an end-to-end service quality. However, it isnot an easy task because of the wide range of colour formats, of capturecapability and of display characteristics. Recently, a new and widercolour space format has been proposed by ITU in the document ITU-RRecommendation BT.2020 (known as Rec. 2020) entitled “Parameter valuesfor UHDTV systems for production and international programme exchange”published in April 2012. Consequently, the compatibility with legacydevices has to be considered. All the rendering devices may not have thecapability to adapt to any colour space nor have the required knowledgeto perform the optimal colour conversion. Indeed, rather than clippingcolours (left part of FIG. 1) one may prefer graceful colour shading forexample as illustrated on the right part of FIG. 1. The determination ofthe colour conversion function is not straightforward because thecontent creation workflows may include deterministic processing (ColourSpace 1 toward Colour Space 2 conversion) but also non-deterministicoperations such as colour grading. If two targeted displays withdifferent characteristics are used (e.g. UHDTV display and Rec.709 HDTVdisplay), both the artistic intent and the colour grading may bedifferent. The colour grading depends both on the contentcharacteristics and the reference display.

As depicted on FIG. 2, in video content distribution, a colour transformis usually applied on the decoded pictures so that the mapped decodedpictures are adapted to the end device rendering capability.

This colour transform also known as Colour Mapping Function (CMF) is forexample approximated by a 3×3 gain matrix plus an offset (Gain-Offsetmodel) or by a 3D Colour LUT.

There is thus a need to encode a colour transform for example in theform of a 3D Colour LUT in bit-streams, possibly transmitted out-ofband. This can provide the necessary flexibility and additional featuresto applications and services on top of HEVC and SHVC video codingstandards.

One solution is to transmit the colour transform or more generallycolour metadata at the transport system level in private streams.However, most of the transmission systems discard those metadata becausethey do not know how to interpret them.

3. BRIEF SUMMARY OF THE INVENTION

The purpose of the invention is to overcome at least one of thedisadvantages of the prior art.

A method for encoding at least one colour transform is disclosed. Themethod comprises:

-   -   encoding first parameters representative of video signal        characteristics of colour output decoded pictures remapped by        the at least one color transform and    -   encoding second parameters representative of the at least one        colour transform.

An encoder for encoding at least one colour transform is disclosed thatcomprises:

-   -   means for encoding first parameters representative of video        signal characteristics of colour output decoded pictures        remapped by the at least one color transform; and    -   means for encoding second parameters representative of the at        least one colour transform.

A decoder for decoding at least one colour transform is disclosed thatcomprises:

-   -   means for decoding first parameters representative of video        signal characteristics of colour output decoded pictures        remapped by the at least one color transform; and    -   means for decoding second parameters representative of the at        least one colour transform.

An encoded video signal representative of at least one colour transformcomprising first parameters representative of video signalcharacteristics of colour output decoded pictures remapped by the atleast one color transform and second parameters representative of the atleast one colour transform. Advantageously, the first and secondparameters are encoded in or decoded from a supplement enhancementinformation message.

According to a variant, at least first and second sets of secondparameters are encoded, the first set being representative of a firstcolour transform and the second set being representative of a secondcolour transform and the first parameters are representative of videosignal characteristics of colour output decoded pictures remapped by thefirst colour transform followed by the second colour transform.

Computer program products are disclosed. They comprise program codeinstructions to execute of the steps of the method for encoding or ofthe method for decoding when this program is executed on a computer.

Processor readable medium are disclosed that have stored thereininstructions for causing a processor to perform at least the steps ofthe method for encoding or of the method for decoding.

4. BRIEF DESCRIPTION OF THE DRAWINGS

Other features and advantages of the invention will appear with thefollowing description of some of its embodiments, this description beingmade in connection with the drawings in which:

FIG. 1 illustrates a colour conversion from a first to a second colourspace with clipping (on the left) or gamut compression (on the right);

FIG. 2 illustrates an architecture of a video decoder that comprisescolour transform to adapt to rendering display characteristics accordingto the prior art;

FIG. 3 represents a flowchart of an encoding method according to anexemplary embodiment of the invention;

FIG. 4 depicts the position of 8 vertices of an octant;

FIG. 5 depicts one octant (layer_id) in grey and its parent octant inblack (layer_id−1);

FIGS. 6A and 6B represent flowcharts of a decoding method according tovarious embodiments of the invention;

FIG. 7 diagrammatically shows an encoder for encoding a colour transformaccording to the invention; and

FIG. 8 diagrammatically shows a decoder for decoding a colour transformaccording to the invention; and

FIG. 9 diagrammatically shows a video coding/decoding system accordingto an exemplary embodiment of the invention.

5. DETAILED DESCRIPTION OF THE INVENTION

The invention relates to a method for encoding a colour transform. Moreprecisely, the method according to the invention comprises encodingcolour mapping information that enable on the decoder side a remappingof the colour samples of the output decoded pictures for customizationto particular display environments. Remap and map are used as synonyms.The remapping process maps/remaps decoded sample values in the RGBcolour space to target sample values. Exemplarily, the mappings areexpressed either in the luma/chroma or RGB colour space domain, and areapplied to the luma/chroma component or to each RGB component producedby colour space conversion of the decoded picture.

FIG. 3 represents a flowchart of an encoding method according to anexemplary and non-limiting embodiment of the invention.

In a step 100, first parameters that describe the colour mapped outputdecoded pictures video signal characteristics are encoded in a stream,e.g. in a SEI message as disclosed below.

In a step 102, second parameters that describe the colour transform areencoded in the stream, e.g. in a SEI message.

Encoding such colour transform metadata makes it possible to preserveartistic intent (what we could call a Director's mode/vision for the TVset instead of/additionally to using native proprietary TV setpost-processing); enhance (e.g. with higher quality graded content likeUHDTV Rec.2020) transmitted coded video if display is capable ofdisplaying such enhanced data and vehicle content colour info whenaddressed/targeted primaries enable a gamut that is much wider (e.g.Rec. 2020) than the actual content gamut. It also makes it possible togracefully degrade (e.g. Rec. 709 colorist grade) a wide colour gamutgraded content (e.g. Rec. 2020 colorist grade) while preserving artisticintent.

An exemplary embodiment is proposed within the framework of the HEVCcoding standard defined in document JCTVC-L1003 of Joint CollaborativeTeam on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IECJTC1/SC29/WG11 or within the framework of the SHVC coding standard whichis the scalable extension of the HEVC coding standard defined indocument JCTVC-L1008 of Joint Collaborative Team on Video Coding(JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 or within theframework of RExt which is the Range extension of the HEVC codingstandard defined in document JCTVC-L1005 of Joint Collaborative Team onVideo Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Astandard defines a syntax that any stream of coded data must comply withto be compatible with this standard. The syntax defines in particularhow the various items of information are coded (for example the datarelating to the pictures included in the sequence, the motion vectors,etc). In the context of SHVC coding standard, the colour transform canbe encoded into the PPS, the VPS or in a SEI message (SEI stands for“Supplemental Enhancement Information”). In the context of RExt codingstandard, the colour transform can be encoded in a SEI message (SEIstands for “Supplemental Enhancement Information”).

According to another advantageous embodiment, the colour transform isencoded in a SEI message (SEI stands for “Supplemental EnhancementInformation”). Exemplarily, the HEVC standard defines in its Annex D theway in which additional information termed SEI is coded. This additionalinformation is referenced in the syntax by a field called payloadType.SEI messages assist for example in processes related to display. Notethat if the decoding device does not possess the functionalitiesnecessary for its use, this information is ignored. According to aspecific embodiment of the invention, a new type of SEI message isdefined so as to code additional information relating to the colourtransform. For this purpose, a new value for the field payloadType isdefined from among the values not yet used (for example payloadType isequal to 24). The syntax of the SEI data (i.e. sei_payload) is extendedin the following manner:

TABLE 1 general colour mapping SEI message Descriptorcolour_mapping_info( payloadSize ) {  colour_map_id ue(v) colour_map_cancel_flag u(1)  if( !colour_map_cancel_flag ) {colour_map_repetition_period ue(v)colour_map_video_signal_type_present_flag u(1)if(colour_map_video_signal_type_present_flag ) { colour_map_video_format u(3)  colour_map_video_full_range_flag u(1) colour_map_description_present_flag u(1)  if(colour_map_description_present_flag) { colour_map_primaries u(8)colour_map_transfer_characteristics u(8) colour_map_matrix_coeffs u(8) } } colour_transform ( )  } }

In this case, the SEI message thus comprises first parameters thatdescribe the colour mapped output decoded pictures video signalcharacteristics and second parameters that describe the colourtransform. The colour mapped output decoded pictures are the picturesremapped/mapped/transformed by the colour transform. Advantageously, theSEI message comprises an additional syntax element colour_map_model_idthat indicates the type of colour transform (3D LUT, three 1D LUTs witha matrix, matrix . . . etc). The Table 1B below is an example of suchindication.

TABLE 1B Interpretation of colour_map_model_id colour_map_model_id Typeof transform 0 3D LUT 1 Matrix with Offsets 2 Three 1D LUTs, i.e. oneper component 3 Three 1D LUTs composed with a matrix and offsets

This syntax element is colour_map_model_id for example encoded after thecolor_map_id element as in the following SEI message. In a variant, thesyntax element colour_map_model_id is the first element in colourtransform( ).

Descriptor colour_mapping_info( payloadSize ) {  colour_map_id ue(v) colour_map_model_id ue(v)  colour_map_cancel_flag u(1)  if(!colour_map_cancel_flag ) { colour_map_repetition_period ue(v)colour_map_video_signal_type_present_flag u(1)if(colour_map_video_signal_type_present_flag ) { colour_map_video_format u(3)  colour_map_video_full_range_flag u(1) colour_map_description_present_flag u(1)  if (colour map descriptionpresent flag) { colour_map_primaries u(8)colour_map_transfer_characteristics u(8) colour_map_matrix_coeffs u(8) } } if(colour _map_model_id = = 0 ) { 3D_ LUT_ colour_data ( ) } elseif(colour _map_model_id = = 1 ) { Matrix_Gain_Offset ( ) } elseif(colour _map_model_id = = 2 ) { Three_1D_LUT_ colour_data ( ) } elseif(colour _map_model_id = = 3 ) { Three_1D_LUT_ colour_data ( )Matrix_Gain_Offset ( ) }  } }

Advantageously, the syntax element colour_map_model_id and possiblycolour_map_id are used to check whether a renderer is capable of usingthe color metadata, i.e. if the renderer is capable of applying thecolor transform transmitted in the SEI message. If the renderer is notcapable of using the color metadata transmitted in a SEI message, thisSEI message is discarded. When several SEI messages are transmitted,each of them describing different color transforms, some of the SEImessages can be discarded while others can be used by the renderer.

The first parameters that describe the colour mapped output decodedpictures video signal characteristics are for example the followingones: colour_map_video_signal_type_present_flag,colour_map_video_format, colour_map_video_full_range_flag,colour_map_description_present_flag, colour_map_primaries,colour_map_transfer_characteristics, colour_map_matrix_coeffs. Thecolour_map_primaries indicates for example the CIE 1931 coordinates ofthe primaries of colour mapped output decoded pictures video signal. Thesecond parameters (colour transform) describe the colour transform andcan be a 3×3 gain matrix plus three offsets or a 3D LUT or any otherparameters describing a colour transform.

A renderer is characterized by the set of

-   -   The first parameters of this SEI message are used by the        renderer to perform the appropriate signal conversion        corresponding to its supported output video formats. output        decoded pictures video signal are compliant with Rec.709, then a        first SEI message SEI1 is encoded with the appropriate transform        T1 to transform this Rec. 709 output decoded pictures video        signal into a Rec. 2020 (i.e. ITU-R BT 2020) mapped output        decoded pictures video signal and a second SEI message SEI2 is        encoded with the appropriate transform T2 to transform this        Rec.709 output decoded pictures video signal into a Rec. 601        colour mapped output decoded pictures video signal. The encoded        signal (lenc+SEI1+SEI2) is sent to a decoder Dec. The decoder        Dec decodes the video signal into an output decoded pictures        video signal Idec and into a first SEI message SEI1 and a second        SEI message SEI2. With this information a Rec. 709 compliant        renderer Disp1 is going to display the Rec. 709 output decoded        pictures video signal Idec and thus disgards the SEI messages. A        Rec.2020 compliant renderer Disp2 is going to display the Rec.        2020 colour mapped output decoded pictures video signal and thus        uses the first SEI message SEI1. This renderer Disp2 applies the        transform T1 decoded from the first SEI message SEI1 to map the        colours of the Rec. 709 output decoded pictures video signal        Idec and displays the colour mapped output decoded pictures        video signal T1 (Idec). If the renderer is a near Rec.2020        compliant display, it may further adapt the Rec. 2020 colour        mapped output decoded pictures video signal to its own        characteristics.

A Rec. 601 compliant renderer Disp3 is going to display the Rec. 601colour mapped output decoded pictures video signal and thus uses thesecond SEI message SEI2. This renderer Disp3 applies the transformdecoded from the second SEI message SEI2 to map the colours of the Rec.709 output decoded pictures video signal Idec and displays the colourmapped output decoded pictures video signal T2 (Idec).

On FIG. 9 a single decoder Dec is represented. According to a variant,several decoders are used, e.g. one for each renderer.

This SEI message provides information to enable remapping of the coloursamples of the output decoded pictures for customization to particulardisplay environments. The remapping process maps coded sample values inthe RGB colour space to target sample values. The mappings are expressedeither in the luma or RGB colour space domain, and should be applied tothe luma component or to each RGB component produced by colour spaceconversion of the decoded picture accordingly.

The decoded color transform is applied to decoded pictures belonging toa layer identified for example by the index nuh_layer_id of the NAL UnitHeader (as defined in section 7.3.1.2 of the document JCTVC-L1003 ofJoint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3).

colour_map_id contains an identifying number that may be used toidentify the purpose of the colour mapping model. Values ofcolour_map_id may be used as determined by the application. Thecolour_map_id can be used to support colour mapping operations that aresuitable for different display scenarios. For example, different valuesof colour_map_id may correspond to different display bit depths.

colour_map_cancel_flag equal to 1 indicates that the colour mappinginformation SEI message cancels the persistence of any previous colourmapping information SEI message in output order. colour_map_cancel_flagequal to 0 indicates that colour mapping information follows.

colour_map_repetition_period specifies the persistence of the colourmapping information SEI message and may specify a picture order countinterval within which another colour mapping information SEI messagewith the same value of colour_map_id or the end of the coded videosequence shall be present in the bitstream. colour_map_repetition_periodequal to 0 specifies that the colour_map information applies to thecurrent decoded picture only.

colour_map_repetition_period equal to 1 specifies that the colour mapinformation persists in output order until any of the followingconditions are true:

-   -   A new coded video sequence begins.    -   A picture in an access unit containing a colour mapping        information SEI message with the same value of colour_map_id is        output having a picture order count (known as POC) greater than        the POC of the current decoded picture, denoted        PicOrderCnt(CurrPic).

colour_map_repetition_period equal to 0 or equal to 1 indicates thatanother colour mapping information SEI message with the same value ofcolour_map_id may or may not be present.

colour_map_repetition_period greater than 1 specifies that the colourmap information persists until any of the following conditions are true:

-   -   A new coded video sequence begins.    -   A picture in an access unit containing a colour mapping        information SEI message with the same value of colour_map_id is        output having a POC greater than PicOrderCnt(CurrPic) and less        than or equal to        PicOrderCnt(CurrPic)+colour_map_repetition_period.

colour_map_repetition_period greater than 1 indicates that anothercolour mapping information SEI message with the same value ofcolour_map_id shall be present for a picture in an access unit that isoutput having a POC greater than PicOrderCnt(CurrPic) and less than orequal to PicOrderCnt(CurrPic)+colour_map_repetition_period, unless thebitstream ends or a new coded video sequence begins without output ofsuch a picture. colour_map_video_signal_type_present_flag,colour_map_video_format, colour_map_video_full_range_flag,colour_map_description_present_flag, colour_map_primaries,colour_map_transfer_characteristics, colour_map_matrix_coeffs semanticis the same as the semantic of the syntax elementsvideo_signal_type_present_flag, video_format, video_full_range_flag,colour_description_present_flag, colour primaries, transfercharacteristics, matrix_coeffs in VUI (specified in Annex E of ITU-TH.265) respectively. However, these syntax elements are advantageosulyused in the present invention to describe the colour mapped outputdecoded pictures video signal characteristics while in the VUI it isused to describe the input video signal characteristics.

According to a variant, several colour transforms (i.e. at least two)are encoded in one and the same SEI message. In this case, the firstparameters describe the colour output decoded pictures video signalcharacteristics remapped by the successive colour transforms. As anexample, in the Table 2A, three colour transforms are encoded. Thesecolor transforms are to be applied successively. The first parametersdescribe the video signal characteristics of the colour output decodedpictures remapped by color_transform1 ( ) followed by color_transform2 () followed by color_transform3 ( )

TABLE 2A Descriptor colour_mapping_info( payloadSize ) {  colour_map_idue(v)  colour_map_cancel_flag u(1)  if( !colour_map_cancel_flag ) {colour_map_repetition_period ue(v)colour_map_video_signal_type_present_flag u(1)if(colour_map_video_signal_type_present_flag ) { colour_map_video_format u(3)  colour_map_video_full_range_flag u(1) colour_map_description_present_flag u(1)  if(colour_map_description_present_flag) { colour_map_primaries u(8)colour_map_transfer_characteristics u(8) colour_map_matrix_coeffs u(8) } } colour_transform1 ( )   colour_transform2 ( )   colour_transform3 ()  } }

As an example, 4 color transforms are encoded that are to be appliedsucessively. The three first color transforms are 3 1D LUT and thefourth color transform is a function Matrix_Gain_Offset ( ).Exemplarily, the colour output decoded pictures comprises threecomponents Y′CbCr or R′G′B′ and each 1D color LUT relates to one colorcomponent. Instead of applying a 3D LUT on the components of the colouroutput decoded pictures, one 1D LUT is applied independently on eachcolor component. This solution reduces memory requirements because itmakes interpolation easier. However, it breaks component mappingcorrelation. Applying a function Matrix_Gain_Offset ( ), for example a3×3 matrix with three offsets, after the three 1D color LUTs makes itpossible to compensate the decorrelation between components byreintroducing component correlation and offsets.

According to a variant, a first set of first parameters describe thevideo signal characteristics of the colour output decoded picturesremapped by the color_transform1 ( ), a second set of first parametersdescribe the video signal characteristics of the colour output decodedpictures remapped by the color_transform2 ( ) and a third set of firstparameters describe the video signal characteristics of the colouroutput decoded pictures remapped by the color_transform3 ( ). Thus, arenderer can either applies successively the three transforms or onlythe first two transforms or only the first transform. According to yetanother variant, a first set of first parameters describe the videosignal characteristics of the colour output decoded pictures remapped byseveral color transforms. Specifically, the first parameters describethe video signal characteristics of the colour output decoded picturesremapped by color_transform1 ( ) or by color_transform2 ( ) or bycolor_transform3 ( ), i.e. the different color transforms thus remap thecolour output decoded pictures towards the same color space. Therenderer is going to apply only one of the several color transforms. Thechoice of the color transform to be applied is made by the renderer, forexample, according to its computation architecture capabilities and/orits embedded circuitry. As an example, in the table 2B below, two colortransforms are encoded. One is represented by a 3D LUT and the other oneby a matrix and offsets as defined in Table 9. Instead of applyingsuccessively the two transforms, the renderer applies only one of them.In this case, the first parameters describe the video signalcharacteristics of the colour output decoded pictures remapped by either3D_LUT_colour_data ( ) or by Matrix_Gain_Offset ( ).

TABLE 2B Descriptor colour_mapping_info( payloadSize ) {  colour_map_idue(v)  colour_map_cancel_flag u(1)  if( !colour_map_cancel_flag ) {colour_map_repetition_period ue(v)colour_map_video_signal_type_present_flag u(1)if(colour_map_video_signal_type_present_flag ) { colour_map_video_format u(3)  colour_map_video_full_range_flag u(1) colour_map_description_present_flag u(1)  if(colour_map_description_present_flag) { colour_map_primaries u(8)colour_map_transfer_characteristics u(8) colour_map_matrix_coeffs u(8) } } 3D_ LUT_ colour_data ( )   Matrix_Gain_Offset ( )  } }colour_transform( ) in Table 1, color_transform1 ( ), color_transform2 (), or colour_transform3( ) in Table 2A are for example defined by thefunction 3D_LUT_colour_data ( ) of Table 3 or 4 or by the functionMatrix_Gain_Offset ( ) of Table 9.

The color transforms in the Table 2B are for example derived from thecolor transforms of Tables 3, 4 and 9. However, an additional syntaxelement colour_map_model_id is encoded that indicates the type oftransform (3D LUT, 1D LUT with a matrix, matrix . . . etc). The syntaxelement colour_map_model_id is for example the first element in thegeneric colour_transform( ).

TABLE 3 coding of the 3D LUT colour data Descriptor 3D_ LUT_ colour_data( ) { nbpCode u(3) coding_octant(0, 0,0,0) }

nbpCode indicates the 3D LUT size as listed in Table 5 for the givenvalue of nbpCode.

According to a variant, 3D_LUT_colour_data ( ) is defined as follows intable 4.

TABLE 4 coding of the 3D LUT colour data Descriptor 3D_ LUT_ colour_data( ) { nbpCode u(3)  NbitsPerSample u(5) coding_octant(0, 0,0,0) }

nbpCode indicates the 3D LUT size as listed in Table 5 for the givenvalue of nbpCode. The quantizer value can be encoded by the3D_LUT_colour_data( ) function.

NbitsPerSample indicates a number of bits used to represent the colourvalues, i.e. the bit depth of the 3D LUT samples.

TABLE 5 Interpretation of nbpCode nbpCode 3D LUT size 0 2 1 3 2 5 3 9 417 5 33

The output of the 3D LUT decoding is a 3 dimension array LUT of sizenbp×nbp×nbp. Each LUT array element is called a vertex and is associatedwith 3 reconstructed sample values (recSamplesY, recSamplesU,recSamplesV) of bit depth equal to (NbitsPerSample). A vertexlut[i][j][k] is said to belonging to layer layer_id if the values of i %(nbp>>layer_id), j % (nbp>>layer_id), k % (nbp>>layer_id) are equal tozero. One vertex may belong to several layers. An octant of layerlayer_id is composed of 8 neighboring vertices belonging to layer_id(FIG. 4).

The decoding of the octant(layer_id, y,u,v) is a recursive function asshown in Table 6.

TABLE 6 syntax elements for coding_octant( ) Descriptor coding_octant (layer_id, y,u,v) {  for( i = 0; i < 8 ; i++ ) { encoded_flag[i] u(1) if( encoded_flag[i] ) {  resY[j] ue(v)  resU[j] ue(v)  resV[j] ue(v) }  } split_flag u(1)  if( split_flag ) { for( i = 0; i < 8 ; i++ ) { coding_octant ( layer_id+1, y+dy[i],u+du[i],v+dv[i]) }  } }

split_flag specifies whether an octant is split into octants with halfhorizontal and vertical size. The values (y,u,v) specify the location ofthe first vertex in the 3D LUT.

Each octant is composed of 8 vertices (i=0, . . . 7) associated with aflag (encoded_flag[i]) indicating whether the residual components values(resY[i],resU[i], resV[i]) are encoded or all inferred to be zero. Thecomponent values are reconstructed by adding the residuals to theprediction of the components values. The prediction of the componentsvalues is computed using for example tri-linear interpolation of the 8neighboring vertices of layer_id−1 (FIG. 5). Once reconstructed a vertexis marked as reconstructed.

TABLE 7 values dy[i], du[i] and dv[i] in function of index i, forvertices belonging to layer = layer_id. If (y + dy[i]), (u + du[i]) and(v + dv[i]) are the 8 children octants coordinates (coordinates of thefirst 3D colour vertex) of the current octant (having (y, u, v) as firstvertex (i = 0) coordinates), the values dy[i], du[i] and dv[i] for agiven layer are depicted in Table 7.i dy[i] du[i] dv[i] 0 0 0 0 1 0 0nbp >> layer_id 2 0 nbp >> 0 layer_id 3 0 nbp >> nbp >> layer_idlayer_id 4 nbp >> 0 0 layer_id 5 nbp >> 0 nbp >> layer_id layer_id 6nbp >> nbp >> 0 layer_id layer_id 7 nbp >> nbp >> nbp >> layer_idlayer_id layer_id

The reconstructed 3D colour LUT samples (recSamplesY[i], recSamplesU[i],recSamplesV[i]) for the vertex ((y+dy[i]), (u+du[i]), (v+dv[i]))belonging to an octant of the layer=layer_id is given by:recSamplesY[i]=resY[i]+predSamplesY[i]recSamplesU[i]=resU[i]+predSamplesU[i]recSamplesV[i]=resV[i]+predSamplesV[i]where the values of predSampleY[i], predSamplesU[i] and predSamplesV[i]are derived using tri-linear interpolation with the 8 vertices of theoctant of layer=layer_id−1 that contains the current octant.

According to a first variant embodiment, the 3D_LUT_colour data ( ) inthe SEI message described above is advantageously replaced by parametersThree_1_D_LUT_colour_data ( ) describing three 1D LUTs.

According to a second variant embodiment, the 3D_LUT_colour_data ( ) inthe SEI message described above is advantageously replaced by parametersdescribing a colour transform such as a 3×3 gain matrix plus threeoffsets as depicted in Tables 8 and 9. The colour transform( ) in Table1 or color_transform1 ( ), color_transform2 ( ) or colour_transform3( )in Table 2b are for example defined by the function Matrix_Gain_Offset () of Table 8.

TABLE 8 Matrix/Offset colour mapping SEI message Descriptorcolour_mapping_info( payloadSize ) {  colour_map_id ue(v) colour_map_cancel_flag u(1)  if( !colour_map_cancel_flag ) {colour_map_repetition_period ue(v)colour_map_video_signal_type_present_flag u(1)if(colour_map_video_signal_type_present_flag ) { colour_map_video_format u(3)  colour_map_video_full_range_flag u(1) colour_map_description_present_flag u(1)  if(colour_map_description_present_flag) { colour_map_primaries u(8)colour_map_transfer_characteristics u(8) colour_map_matrix_coeffs u(8) } } Matrix_Gain_Offset ( )  } }

TABLE 9 syntax elements for ( ) Descriptor Matrix_Gain_Offset ( ) { For(i=0;i<9;i++){  Gain[i] u(8) } For (i=0;i<3;i++){ Offset[i] u(8) } }

Gain[i] represents the values of the matrix coefficients and Offset[i]represents the values of the offsets.

FIG. 6A represents a flowchart of a decoding method according to anexemplary and non-limiting embodiment of the invention.

In a step 200, the first parameters that describe the colour mappedoutput decoded pictures video signal characteristics are decoded from astream, e.g. from a SEI message as disclosed above.

In a step 202, the second parameters that describe the colour transformare decoded from the stream, e.g. from a SEI message.

In a variant depicted on FIG. 6B, the method further comprises decoding(step 204) colour pictures from a stream and remapping (step 206) thedecoded colour pictures with the colour transform into colour mappedoutput decoded pictures. The colour mapped output decoded pictures maythen be displayed. According to a specific and non-limiting embodiment,the colour mapped output decoded pictures and the first parameters aretransmitted to a display. The first parameters may be used by thedisplay to interpret the colour mapped output decoded pictures.

FIG. 7 represents an exemplary architecture of an encoder 1 configuredto encode the first and second parameters in a stream. Encoder 1comprises following elements that are linked together by a data andaddress bus 64:

-   -   a microprocessor 61 (or CPU), which is, for example, a DSP (or        Digital Signal Processor);    -   a ROM (or Read Only Memory) 62;    -   a RAM (or Random Access Memory) 63;    -   one or several I/O (Input/Output) devices 65 such as for example        a keyboard, a mouse, a webcam, and    -   a power source 66.

According to a variant, the power source 66 is external to the encoder.Each of these elements of FIG. 7 are well known by those skilled in theart and won't be disclosed further. In each of mentioned memory, theword «register» used in the specification designates in each of thememories mentioned, both a memory zone of low capacity (some binarydata) as well as a memory zone of large capacity (enabling a wholeprogram to be stored or all or part of the data representative of datacalculated or to be displayed). ROM 62 comprises a program and encodingparameters. Algorithm of the encoding method according to the inventionis stored in the ROM 62. When switched on, the CPU 61 uploads theprogram 620 in the RAM and executes the corresponding instructions.

RAM 63 comprises, in a register, the program executed by the CPU 61 anduploaded after switch on of the encoder 1, input data in a register,encoded data in different state of the encoding method in a register andother variables used for encoding in a register.

FIG. 8 represents an exemplary architecture of a decoder 2 configured todecode the first parameters and second parameters from a stream. Decoder2 comprises following elements that are linked together by a data andaddress bus 74:

-   -   a microprocessor 71 (or CPU), which is, for example, a DSP (or        Digital Signal Processor);    -   a ROM (or Read Only Memory) 72;    -   a RAM (or Random Access Memory) 73;    -   an I/O interface 75 for reception of data to transmit, from an        application; and    -   a battery 76.

According to a variant, the battery 76 is external to the encoder. Eachof these elements of FIG. 8 are well known by those skilled in the artand won't be disclosed further. In each of mentioned memory, the word«register» used in the specification can correspond to area of smallcapacity (some bits) or to very large area (e.g. a whole program orlarge amount of received or decoded data). ROM 72 comprises at least aprogram and decoder parameters. Algorithm of the decoding methodaccording to the invention is stored in the ROM 72. When switched on,the CPU 71 uploads the program 720 in the RAM and executes thecorresponding instructions.

RAM 73 comprises, in a register, the program executed by the CPU 71 anduploaded after switch on of the decoder 2, input data in a register,decoded data in different state of the decoding method in a register,and other variables used for decoding in a register.

After decoding the first and second parameters, remapping of the decodedcolour pictures with the colour transform may be achieved by the decoderin a Set-top-Box or a Blu-Ray player. In this case, the colour mappedoutput decoded pictures and the first parameters or part of them may betransmitted to a display (e.g. using HDMI, SDI, Display Port, DVI). Thedisplay may then use the first parameters to interpret the colour mappedoutput decoded pictures for their rendering. In a variant, remapping ofthe decoded colour pictures with the colour transform is achieved in aTV set specifically in a built-in decoder. In this case, the firstparameters are used to interpret the colour mapped output decodedpictures for rendering.

The implementations described herein may be implemented in, for example,a method or a process, an apparatus, a software program, a data stream,or a signal. Even if only discussed in the context of a single form ofimplementation (for example, discussed only as a method or a device),the implementation of features discussed may also be implemented inother forms (for example a program). An apparatus may be implemented in,for example, appropriate hardware, software, and firmware. The methodsmay be implemented in, for example, an apparatus such as, for example, aprocessor, which refers to processing devices in general, including, forexample, a computer, a microprocessor, an integrated circuit, or aprogrammable logic device. Processors also include communicationdevices, such as, for example, computers, cell phones, portable/personaldigital assistants (“PDAs”), and other devices that facilitatecommunication of information between end-users.

Implementations of the various processes and features described hereinmay be embodied in a variety of different equipment or applications,particularly, for example, equipment or applications. Examples of suchequipment include an encoder, a decoder, a post-processor processingoutput from a decoder, a pre-processor providing input to an encoder, avideo coder, a video decoder, a video codec, a web server, a set-topbox, a laptop, a personal computer, a cell phone, a PDA, and othercommunication devices. As should be clear, the equipment may be mobileand even installed in a mobile vehicle.

Additionally, the methods may be implemented by instructions beingperformed by a processor, and such instructions (and/or data valuesproduced by an implementation) may be stored on a processor-readablemedium such as, for example, an integrated circuit, a software carrieror other storage device such as, for example, a hard disk, a compactdiskette (“CD”), an optical disc (such as, for example, a DVD, oftenreferred to as a digital versatile disc or a digital video disc), arandom access memory (“RAM”), or a read-only memory (“ROM”). Theinstructions may form an application program tangibly embodied on aprocessor-readable medium. Instructions may be, for example, inhardware, firmware, software, or a combination. Instructions may befound in, for example, an operating system, a separate application, or acombination of the two. A processor may be characterized, therefore, as,for example, both a device configured to carry out a process and adevice that includes a processor-readable medium (such as a storagedevice) having instructions for carrying out a process. Further, aprocessor-readable medium may store, in addition to or in lieu ofinstructions, data values produced by an implementation.

As will be evident to one of skill in the art, implementations mayproduce a variety of signals formatted to carry information that may be,for example, stored or transmitted. The information may include, forexample, instructions for performing a method, or data produced by oneof the described implementations. For example, a signal may be formattedto carry as data the rules for writing or reading the syntax of adescribed embodiment, or to carry as data the actual syntax-valueswritten by a described embodiment. Such a signal may be formatted, forexample, as an electromagnetic wave (for example, using a radiofrequency portion of spectrum) or as a baseband signal. The formattingmay include, for example, encoding a data stream and modulating acarrier with the encoded data stream. The information that the signalcarries may be, for example, analog or digital information. The signalmay be transmitted over a variety of different wired or wireless links,as is known. The signal may be stored on a processor-readable medium.

A number of implementations have been described. Nevertheless, it willbe understood that various modifications may be made. For example,elements of different implementations may be combined, supplemented,modified, or removed to produce other implementations. Additionally, oneof ordinary skill will understand that other structures and processesmay be substituted for those disclosed and the resulting implementationswill perform at least substantially the same function(s), in at leastsubstantially the same way(s), to achieve at least substantially thesame result(s) as the implementations disclosed. Accordingly, these andother implementations are contemplated by this application.

The invention claimed is:
 1. A non-transitory processor-readable storagemedium comprising instructions that cause a processor to perform:decoding first parameters representative of video signal characteristicsof decoded pictures color mapped by at least one color transform, thefirst parameters comprising at least one syntax element of a pluralityof syntax elements, each syntax element of the plurality of syntaxelements (i) describing the decoded pictures color mapped by the atleast one color transform and (ii) having the same semantics as acorresponding video usability information (VUI) syntax element; anddecoding second parameters representative of the at least one colortransform.
 2. The storage medium according to claim 1, wherein the firstparameters comprise at least one of the following syntax elements: avideo signal range indicating a black level and range of the colorcomponents; color primaries; a transfer characteristic; and matrixcoefficients for deriving luma and chroma signals from RGB primaries. 3.The storage medium according to claim 1, wherein the first parametersfurther comprise a fifth syntax element for identifying a purpose of acolor mapping model.
 4. The storage medium according to claim 1, whereinthe first and second parameters are encoded in a SupplementalEnhancement Information message.
 5. The storage medium according toclaim 4, wherein the first parameters further comprise a sixth syntaxelement indicating that the color mapping information SupplementalEnhancement Information message cancels persistence of any previouscolor mapping information Supplemental Enhancement Information messagein output order in the case where the sixth syntax element equals to 1and indicating that color mapping information follows in the case wherethe sixth syntax element equals to
 0. 6. The storage medium according toclaim 4, wherein the first parameters further comprise a seventh syntaxelement specifying persistence of the color mapping informationSupplemental Enhancement Information message.
 7. An apparatuscomprising: a processor operably coupled with a memory and configured toperform: transmitting first parameters representative of video signalcharacteristics of decoded pictures color mapped by at least one colortransform, the first parameters comprising at least one syntax elementof a plurality of syntax elements, each syntax element of the pluralityof syntax elements (i) describing the decoded pictures color mapped bythe at least one color transform and (ii) having the same semantics as acorresponding video usability information (VUI) syntax element; andtransmitting second parameters representative of the at least one colortransform.
 8. The apparatus according to claim 7, wherein the firstparameters comprise at least one of the following syntax elements: avideo signal range indicating a black level and range of the colorcomponents; color primaries; a transfer characteristic; and matrixcoefficients for deriving luma and chroma signals from RGB primaries. 9.The apparatus according to claim 7, wherein the first parameters furthercomprise a fifth syntax element for identifying a purpose of a colormapping model.
 10. The apparatus according to claim 7, wherein the firstand second parameters are encoded in a Supplemental EnhancementInformation message.
 11. The apparatus according to claim 10, whereinthe first parameters further comprise a sixth syntax element indicatingthat the color mapping information Supplemental Enhancement Informationmessage cancels persistence of any previous color mapping informationSupplemental Enhancement Information message in output order in the casewhere the sixth syntax element equals to 1 and indicating that colormapping information follows in the case where the sixth syntax elementequals to
 0. 12. The apparatus according to claim 10, wherein the firstparameters further comprise a seventh syntax element specifyingpersistence of the color mapping information Supplemental EnhancementInformation message.
 13. A method comprising: transmitting firstparameters representative of video signal characteristics of decodedpictures color mapped by at least one color transform, the firstparameters comprising at least one syntax element of a plurality ofsyntax elements, each syntax element of the plurality of syntax elements(i) describing the decoded pictures color mapped by the at least onecolor transform and (ii) having the same semantics as a correspondingvideo usability information (VUI) syntax element; and transmittingsecond parameters representative of the at least one color transform.14. The method according to claim 13, wherein the first parametersrepresentative of video signal characteristics comprise at least one ofthe following syntax elements: a video signal range indicating a blacklevel and range of the color components; color primaries; a transfercharacteristic; and matrix coefficients for deriving luma and chromasignals from RGB primaries.
 15. The method according to claim 13,wherein the first parameters further comprise a fifth syntax element foridentifying a purpose of a color mapping model.
 16. The method accordingto claim 13, wherein the first and second parameters are encoded in aSupplemental Enhancement Information message.
 17. The method accordingto claim 16, wherein the first parameters further comprise a sixthsyntax element indicating that the color mapping informationSupplemental Enhancement Information message cancels persistence of anyprevious color mapping information Supplemental Enhancement Informationmessage in output order in the case where the sixth syntax elementequals to 1 and indicating that color mapping information follows in thecase where the sixth syntax element equals to
 0. 18. The methodaccording to claim 16, wherein the first parameters further comprise aseventh syntax element specifying persistence of the color mappinginformation Supplemental Enhancement Information message.
 19. The methodaccording to claim 16, wherein the plurality of syntax elementscomprises: a first syntax element describing the decoded pictures colormapped by the at least one color transform, wherein the first syntaxelement has the same semantics as a Video Usability Information videofull range flag syntax element; a second syntax element describing thedecoded pictures color mapped by the at least one color transform,wherein the second syntax element has the same semantics as a VideoUsability Information color primaries syntax element; a third syntaxelement describing the decoded pictures color mapped by the at least onecolor transform, wherein the third syntax element has the same semanticsas a Video Usability Information transfer characteristics syntaxelement; and a fourth syntax element describing the decoded picturescolor mapped by the at least one color transform, wherein the fourthsyntax element has the same semantics as a Video Usability Informationmatrix coefficients syntax element.
 20. The apparatus according to claim7, wherein the plurality of syntax elements comprises: a first syntaxelement describing the decoded pictures color mapped by the at least onecolor transform, wherein the first syntax element has the same semanticsas a Video Usability Information video full range flag syntax element; asecond syntax element describing the decoded pictures color mapped bythe at least one color transform, wherein the second syntax element hasthe same semantics as a Video Usability Information color primariessyntax element; a third syntax element describing the decoded picturescolor mapped by the at least one color transform, wherein the thirdsyntax element has the same semantics as a Video Usability Informationtransfer characteristics syntax element; and a fourth syntax elementdescribing the decoded pictures color mapped by the at least one colortransform, wherein the fourth syntax element has the same semantics as aVideo Usability Information matrix coefficients syntax element.
 21. Thenon-transitory processor-readable storage medium of claim 1, wherein theplurality of syntax elements comprises: a first syntax elementdescribing the decoded pictures color mapped by the at least one colortransform, wherein the first syntax element has the same semantics as aVideo Usability Information video full range flag syntax element; asecond syntax element describing the decoded pictures color mapped bythe at least one color transform, wherein the second syntax element hasthe same semantics as a Video Usability Information color primariessyntax element; a third syntax element describing the decoded picturescolor mapped by the at least one color transform, wherein the thirdsyntax element has the same semantics as a Video Usability Informationtransfer characteristics syntax element; and a fourth syntax elementdescribing the decoded pictures color mapped by the at least one colortransform, wherein the fourth syntax element has the same semantics as aVideo Usability Information matrix coefficients syntax element.